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(54) Apparatus for parallel decoding of digital video signals 

(57) Anovel apparatus fbrdecoding an encodeddig- 
ital video signal is able to carry out a parallel processing, 
without using a shared memory system. This apparatus 
comprises detector for detecting slice start codes from 
the encoded digital video signal and generating a slice 
start detection signal, control unit for counting ttie 
nun*er of the slice start codes of the encoded b*t stream, 
and for generating a control signal in response to the 
counted number of the slice start codes, switcWng block 
for dividing video frame data into two subframes, two 
f irst-inf irst-out(FIFO) buffers for storing the divided video 
frame data, a image processing device for decompress- 
ing the encoded digital video signal and reproducing the 
original video image signal, and frame formatter for cou- 
pling the reproduced original video image signal. 
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Description 

Reld of the Invention 

The present invention relates to a video imaging sys- 
tem: and. more particularly, to' an improved video image 
decoding apparatus having two decoding modules for 
decompressing incoming compressed video image data 
in parallel. 

pegcription Pf thg Prior Art 

In various electronic/electrical applicatrons such as 
high definition television and video telephone systems, 
an image signal may need be transmitted in a digitized 
form. When the image signal is expressed in a digitized 
form, there is bound to occur a substantial amount of dig- 
ital data. Since, however, the available frequency band- 
width of a conventional transmission channel is limited, 
in order to transmit the image signal therethrough, the 
use of an image signal encoding apparatus becomes 
necessary to compress the substantial amounts of digital 
data. 

Accordingly, most image signal encoding apparatus 
employ various compression techniques (or coding 
methods) built on the idea of utilizing or reducing spatial 
and/or temporal redundancies inherent in the input 
image signal. 

Among the various video compression techniques, 
the so-called hybrid coding technique, which combines 
temporal and spatial compression techniques together 
with a statistical coding technique, is known to be most 
effective. 

Most hybrid coding techniques employ a motion 
compensated DPCM(differential pulse code nxxlula- 
tion), two<Jimensional DCT(discrele cosine transform), 
quantization of DCT coefficients, and VLC(variable 
length coding). The motion compensated DPCM is a 
process of determining the movement of an object 
between a cun^ent frame and its previous frame, and pre- 
dicting the cunent frame according to the motion flow of 
the object to produce a differential signal representing 
the difference between the cunent frame and its predic- 
tion. This method is desalbed. for example, in Staffan 
Ericsson, "Fixed and Adaptive Predictors for Hybrid Pre- 
dlctVe/Transfbrm Coding", IEEE Transactions on Com- 
munications, CQM-33. No. l2(December 1985): and in 
Ninomiya and Ohtsuka, "A Motion Compensated Inter- 
frame Coding Scheme for Television Pictures". IEEE 
Transactions on Communications. COM-30. No. 1 (Jan- 
uary 1982). 

The two-dimensional DCT, which reduces or 
removes spatial redundancies between image data such 
as motion compensated DPCM data, converts a block of 
digital imagedata. for example, a block of 8x8 pixels, into 
a set of transform coefficient data. This technique is 
described in Chen and Pratt. "Scene Adaptive Coder". 
IEEE Transactions n" Communications. COM-32. No. 
3{March 1984). By processing such transform coeff icient 



data with a quantizer, zigzag scanner and VLC circuit, 
the amount of data to be transmitted can be effectively 
compressed. 

Specifically, in tiie motion compensated DPCM. cur- 

5 rent frame data is predicted from previous frame data 
based on an estimation of tiie motion between tiie cur- 
rent and the previous frames. Such estimated motion 
may be described in terms of two dimensional motion 
vectors representing tiie displacement of pixels between 

10 the previous and the cunrent frames. 

In order to compress the image signals with tiie 
above mentioned technique, tiie use of a processor 
capatrfe of canrying but a high speed processing 
becomes necessary, and this is usually achieved by 

IS employing a parallel processing technique. Generally, in 
tiie image signal decoding apparatus having tfie parallel 
processing capability, one video image frame area is 
divided into a plurality of subframes. and image data 
within tiie video image frame area is processed on a sub- 

20 frame-by-subframe basis. 

Oh the other hand, to determine a motion vector for 
a search block in tiie current frame, a similarity calcula- 
tion is performed l)etween the search block of the current 
frame and each of a plurality of equal-sized candidate 

25 blocks included in a generally larger search region wrttiin 
a previous frame, wherein the size of the search block 
typically ranges between 8x8 and 32x32 pixels. Conse- 
quentiy. tiie search region containing a boundary portion 
of any subframe also includes a boundary portion of a 

30 neighboring subframe. Accordingly, the motion estima- 
tion carried out by each processor requires a shared 
memory system witii a multiple random access capabil- 
ity. 

35 Summary Of the inventipn 

It is. tiierefbre, a primary object of tiie present inven- 
tion to provide an improved video image decoding appa- 
ratus capable of canrying out a parallel processing. 

40 without having to use a shared memory system witii a 
multiple random access capability. 

In accordance witii tiie present invention, there is 
provided an apparatus for decoding an encoded digital 
video signal in an encoded bit stream for tile reproduc- 

45 tion of an original video image signal, wherein the 
encoded digital video signal includes a plurality of video 
frame data, each video frame data having a number of 
slice start codes representing a start of each slice 
tiierein, said apparatus comprising: means for detecting 

so tiie slice start codes from tiie encoded digital vkleo signal 
and generating a slice start detection signal: control 
means for counting the number of tiie slice start codes 
of tiie encoded bit stream in response to tiie slice start 
detection signal, and for generating a control signal in 

55 response to the counted number of the slice start codes: 
means, responsive to the conti-ol signal, for dividing 
video frame data into two subframes: two first-in first- 
out(FlFO) buffers for storing the divided video frame 
data: image processing means for decompressing tiie 
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encoded input data and reproducing the original video 
Image signal; and means for coupling the reproduced 
original video image signal. The image processing 
means includes two decoder modules and a frame mem- 
ory part for reproducing the original video image signal, 
wherein each decoder module reproduces each of the 
two subframes, and the memory part includes two rnem- 
ory modules for storing the divided video frame data, a 
memory module selection controller for generating first 
and second selection signals, and first and second 
address data, and selecting means for producing pixel 
data stored in the corresponding memory nfKxJutes in 
response to the first and second selection signals. 

Brief Description of the Drawings 

The atDove and other objects and features of the 
present invention will become apparent from the follow- 
ing description of preferred embodiments given in con- 
junction with the accompanying drawings. In which: 

Fig. 1 is a schematic representation of a video image 
frame area divided Into two subframes; 
Fig. 2 represents a block diagram of tiie inventive 
decoding apparatus comprising an Image data par- 
titioning circuit and an Image processing device; 
Fig. 3 presents a more detailed block diagram of the 
Image processing device coupled to the image data 
partitioning circuit shown in Fig. 2; and 
Fig. 4A and 4B describe a timing diagram represent- 
ing the order of processing for each subframe. 

Detailed Description of the Prefenred Embodiments 

The present invention provides for tiie communica- 
tion of high definition television(HDTV) signals from a 
transmitter location to a population of receivers. At tiie 
transmitter of an encoder" end of tiie communication link, 
digital video signals for successive frames of a television 
picture are broken down Into subframes for processing 
by multiple processors. The inventive decoding appara- 
tus includes two decoder modules, each of which is ded- 
icated to the decoding of video data from a particular 
sut)frame. 

Referring to Rg. 1. ttiere is shown a vkieo Image 
frame area 10 divided into two subframes. The total 
frame area encompasses M horizontal picture lines, 
each picture line containing N pixels. For exarrple. a sin- 
gle HDTV frame comprises 960 picture lines, each pic- 
ture line Including 1408 pixels. In ottier words, a single 
HDTV frame comprises 60 slices, each slice including 
16 horizontal picture lines. 

In accordance witii the present invention, a video 
Image frame area is divided Into two subframes. e.g., 
subframes 13. 16 as lllusta^ated in Rg. 1. 

In order to process the two subframes. a processor 
is assigned to each subframe for decompressing com- 
pressed distal data bounded by tiie subframe In a video 
frame. In an encoding apparatus, data redundancies 



between a current video frame and one or more of its 
prior video frames is reduced using a motion estima- 
tion/compensation technique. 

Referring to Rg. 2. there is illustrated a block dia- 

s gram of the inventive parail el Image decoding apparatus, 
which comprises an image data partitioning circuit 30 
and an Image processing device 40. 

The image data partitioning circuit 30 which includes 
a slice start code(SSC) detector 31 , a control unit 32, a 

10 switching block 33. and two f irst-in f irst-out(FIFO) buffers 
34, 35 is coupled to the image processing device 40; and 
serves to divide the encoded digital data into two sub- 
frames for the processing tiiereof on a subframe-by-sub- 
frame basis. The Image processing device 40 includes 

15 two decoder modules 50. 60. each of the decoder mod- 
ules having variable length decoding(VLD) circuits 51, 
61, motion compensators 52, 62. inverse zigzag scan- 
ners 53. 63. inverse quantizers(IQs) 54. 64. inverse dis- 
crete cosine transform(IDCT) circuits 55. 65 and adders 

20 56, 66 deconpresses compressed input digital data In 
connection with a frame memory part 70. respectively 
As shown in Rg. 2, a variable length encoded digital 
video signal received from an encoding apparatus(not 
shown) is inputted via terminal 20 to the SSCs detector 

25 31 . The encoded digital vkJeo signal includes a plurality 
of video frame data, each of said video frame data occu- 
pying a video image frame area has variable length 
coded transform coeffidents, motion vectors and a 
number of SSCs. wherein each BSC represents a start 

30 of a slice included in the encoded bit stream. The BSC 
detector 31 detects slice start codes from tiie encoded 
digital video signal and generates a slice start detection 
signal to the control unit 32 which serves to control tiie 
witching bkxik 33. The control unit 32 counts tiie 

35 number of SSCs in response to the slice start detection 
signal provided from tiie BSC detector 31 . Whenever tiie 
counted number of tiie SSCs reaches a predetermined 
value. e.g.. 30, a control signal for alternately switching 
tiie encoded digital video signal supplied from tiie BSC 

40 detector 31 between SI and B2 is generated by tiie con- 
frol unit 32, thereby dividing each frame of tiie incoming 
encoded image signal into two subframes and storing 
ttiem in two FIFO buffers 34. 35. The FIFO buffers output 
tiie subframe data to. corresponding decoder modules 

45 50. 60. Incorporated in the image processing device 40, 
each of said decoder modules is dedicated to tiie 
processing of video image data bounded by a particular 
subframe and substantially Identical each otiier. The 
image processing device 40 reconstixicts a discrete 

50 cosine ti'ansfbrm(DCT) coefficients, performs a motion 
compensation leased on a motion vector, and constitutes 
representative image data of a given block in tiie cun-ent 
frame. The decoded subframe data from the Image 
processing device 40 is sent to a frame formatter 80 and 

55 combined therein to form a single data stream represent- 
ing tiie original video image signal to be, e.g.. displayed 
on a display unit(not shown). 

Referring now to Rg. 3, tiiere Is shown a more 
detailed blodc diagram of the image processing de^ce 
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40 coupled to the image data partitioning circuit 30 
shewn in Fig. 2. The decoder modules 50 and 60 con- 
tained In the image processing device 40 are made of 
identical elements, each element sennng a same func- 
tion. 

As shown in Rg. 3, video image data bounded by a 
particular subframe is provided from the image data par- 
titioning circuit 30 to variable length decoding(VLD) cir- 
cuits 51, 61 through lines 501, 601. respectively. Each 
VLD circuit processes the video image data bounded by 
a corresponding subframe. That is, each VLD circuit 
decodes the variable length coded transform coefficients 
and the motion vectors to send the transform coefficient 
data to respective inverse zigzag scanners 53. 63 and 
the motion vector data to each of the motion compensa- 
tors 52. 62, incorporated in the decoder modules. The 
VLD circuits are basically a look-up table: that is. In the 
VLD circuits, a plurality of code sets is provided to define 
respective relationships between variable length codes 
and their run-length codes or motion vectors. The output 
from each VLD circuit is then distributed to a correspond- 
ing processor. Each processor processes video image 
data bounded by a corresponding subframe. 

Video image data bounded by the first subframe 1 3 
shown in Rg. 1 is provided from the VLD circuit 51 to the 
inverse zigzag scanner 53 through a line 503. In tiie 
inverse zigzag scanner 53, the quantized DCT coeffi- 
dents are reconstructed to provide an original trfock of 
quantized DCT coefficients. A block of quantized DCT 
coefficients is converted into DCT coefficients in the 
inverse quarrtizer(IQ) 54 and fed to the inverse discrete 
cosine transform(IDCT) circuit 55 which transforms the 
DCT coefficients into difference data between a block of 
the current subframe and its corresponding block of the 
previous sut)frame. The difference data from tiie IDCT 
circuit 55 is then sent to tiie adder 56. 

In the meanwhile, the variable lengtii decoded 
motion vector from the VLD circuit 51 is fed to tiie motion 
compensator 52 and a memory module selection con- 
troller 75 witiiin the frame memory part 70 via lines 502 
and 701. The motion compensator 52 extracts corre- 
sponding pixel data from tiie previous subframe stored 
in tiie frame memory part 70 based on tiie motion vector 
and sends the conresponding pixel data to the adder 56. 
The corresponding pixel data derived from the motion 
conrpensator 52 and tiie pixel difference data from the 
IDCT circuit 55 are summed up at tiie adder 56 to con- 
stitute representative image data of a given block of the 
cunrent subframe and written onto ttie first memory mod- 
ule 71 and transmitted to the frame fbmiatter 80 as 
shewn In Fig. 2. 

Also, the decoder module 60 is similar to the 
decoder module 50 in structure and operation. In otfier 
words, video image data bounded by the second sub- 
frame 1 6 shown in Rg. 1 is provided from the VLD drcuit 
61 to tfie inverse zigzag scanner 63 via a line 603. and 
the quantized DCT coefficients are reconstructed 
therein. The quantized DCT coefficients are converted 
into DCT coefficients in tiie IQ 64 and fed to tiie IDCT 



drcuit 65. tiiereby fransforming tiie DCT coeff idents into 
difference data between a block of tiie cun-ent subframe 
and its corresponding t)lock of the previous subframe. 
The difference data from tiie IDCT circuit 65 is then sent 
5 to the adder 66. 

In ttie meanwhile, tiie motion vector from tiie VLD 
drcuit 61 is fed to tiie motion compensator 62 and tiie 
memory module selection controller 75 via lines 602 and 
702. The motion compensator 62 extracts corresponding 
10 pixel data from the previous subframe stored in tiie frame 
memory part 70 based on tiie motion vector and provides 
tfie corresponding pixel data to tfie adder 66. The corre- 
sponding pixel data derived from tiie motion compensa- 
tor 62 and tiie pixel difference data from the IDCT drcuit 
15 65 are summed up at the adder 66 to constitute repre- 
sentative image data of a given block in the current sub- 
frame and written onto the second memory module 72 
and ta^nsmitted to the frame formatter 80 as shown in 
Fig. 2. 

In accordance witii tiie present invention, one video 
image frame area is divided into two subframes, each of 
tfie subframe data being processed through tiie use of 
a corresponding decoder module. In this case, when tiie 
boundary portion between the two subframes, e.g., slice 
30 or slice 31 shown in Rg, 1 , is processed, tiie motion 
compensator 52 or 62 may access one of the memory 
modules 71 , 72. That is. if the first motion vector provided 
from the VLD circuit 51 is found in ttie subframe 1 6 during 
tiie processing of ttie slice 30 wittiin the subframe 1 3. ttie 
motion compensator 52 should access tiie memory 
module 72. Similarly, if the second motion vector applied 
from tiie VLD drcuit 61 is in the stdDframe 13 during tiie 
processing of the slice 31. the motion compensator 62 
should access tiie memory module 71. At this time, the 
motion compensation process perfbnned by each of tiie 
two decoder modules is controlled to prevent tiie two 
motion compensators from concun-ently attempting to 
access a same memory module. In ottier words, tfie two 
memory modules are made to have an appropriate dead- 
lock so tfiat tiie two motion compensators do not access 
a same memory module, simultaneously. A more 
detailed description of the above mentioned operation 
will be provided with reference to Fig. 4. 

As shown in Rg. 3. for this mutually exdusive mem- 
ory module access, tfie frame memory part 70 indudes 
tw6 memory modules 71 , 72, ttie two multiplexer circuits 
73, 74 and the memory module selection cohtf-oller 75. 
At the memory module selection controller 75, it is 
checked whether the motion vectors are in an adjacent 
subframe. 

The memory module selection controller 75 receives 
first and second motion vectors from ttie VLD circuits 51 . 
61 via lines 701, 702 and generates first and second 
selection signals ttirough lines 703. 704 to the multi- 
plexer circuits 73. 74. Also, tiie memoi-y module selection 
controller 75 simultaneously produces first and second 
address data via lines 705, 706 to the memory modules 
71,72. 
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When each of the motion vectors provided from the 
VLD drcuits to the memory module selection controller 
75 is in each of the corresponding subf rames, the mem- 
ory module selection controller 75 generates the first and 
second selection signals, e.g., logic low", to multiplexer 5 
circuits 73, 74. Each multiplexer circuit outputs corre- 
sponding pixel data from the presnous subframe stored 
in the corresponding memory module based on the 
motion vectors, in response to the first and second selec- 
tion signals with a said logic "low". That is, when the first 10 
selection signal is a logic "low", the multiplexer circuit 73 
furnishes the pixel data supplied from the memory mod- 
ule 71 to the motion conpensator 52. Similarly, when the 
second selector signal is a logic "low", the multiplexer 
circuit 74 offers the pixel data supplied from the memory 75 
module 72 to the motion compensator 62. 

When each of the motion vectors is in another adja- 
cent subframe, the first and second selection signals pro- 
duced by the memory module selection controller 75 are 
logic "high". In this case, the nuiltiplexer drcuhs 73 and 20 
74 output the pixel data from the memory modules 72 
and 71 , respectively. As noted above, the mutually exclu- 
sive memory accessing operation between the two 
memory modules 71 , 72 is performed under the control 
of the memory module selection controller 75. 25 

Referring now to Rgs. 4A and 4B, there is shown a 
timing diagram representing tiie order of processing for 
each subframe. 

As indicated in Rg. 4. tiie decoder module 50 starts 
the processing of the video image data occupying the 30 
subframe 13. After processing all of the slices contained 
in the subframe 13. the processing of the subframe 16 
is commenced by the decoder module 60, At this time, 
the decoder module 50 has a deadlock until the decoder 
module 60 completes the processing of the slice 31 in ss 
the subframe 1 6 in order to prevent the two nrration com- 
pensators 52, 62 S|hown in Fig. 3 from accessing a same 
memory module. When the slice 31 is processed by the 
decoder module 60, the decoder module 50 begins the 
processing of next subframe data, e.g., slice 1', in a next 40 
video image frame area. The decoder module 60 has a 
deadlock until the decoder module 50 completes the 
procesising of the slice 30' in said next video image frame 
area, in this manner, each of the decoder modules 50, 
60 repeats the decoding operation until all of the incom- 45 
Ing video image data is processed. 

While the present invention has been described with 
respect to certain preferred embodiments only, other 
modifications and variations may be made without 
departing from the spirit and scope of the present inven- so 
tion as set forth in the following claims. 

Claims 

1. An apparatus for decoding an encoded digital video ss 
signal in an encoded bit stream for the reproduction 
of an original video image signal, wherein the 
encoded digital video signal includes a plurality of 
video frame data, each video frame data having a 



number of slice start codes representing a start of 
each slice therein, which comprises: 

means for detecting the slice start codes from 
the encoded digital video signal and generating a 
slice start detection signal; 

control means for counting tiie number of tiie 
slice start codes in the encoded bit stream in 
response to tiie slice start detection signal, and for 
generating a control signal in response to tiie 
counted number of the slice start codes; 

means, responsive to the control signal, for 
dividing video frame data into two subframes; 

two first-in first-out(FlFO) buffers for storing 
tiie divided video frame data; 

image processing means for decompressing 
tiie encoded digital video signal and reproducing the 
original video image signal; and 

means for coupling the reproduced original 
video image signal. 

2. The apparatus of claim 1, wherein the image 
processing means includes two decoder modules 
and a frame memory part for reproducing the origi- 
nal video image signal, wherein each of the decoder 
modules generates tiie decompressed digital video 
signal, and tiie frame memory part includes two 
memx^ry modules for storing tiie decompressed dig- 
ital video signal, a memory module selection con- 
troller for generating first and second selection 
signals and first and second address data, and 
selecting means for producing pixel data stored in 
tiie corresponding memory modules in response to 
the first and second selection signals. 
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